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Chapter 1. PB^OGRAM DESCRIPTIOK 

This is a report of the evaluation of the Bilingual Program 
at Adlai E. Stevenson High School in the South Bronx in New York 
City for school year of 1975-76. 

The Comprehensive Bilingual Education prograia at Adlai 
Stevenson High School in South BronK was designed to offer bilingual 
instructional and supportive eervices to ninths tenths and eleventh 
grade high school students under funding from Title VII in the 
period from September , 1975 through June^ 1976, 

The target population consisted of approKimately 250 Spanigh 
speaking boys and girls, ^en tested 93 recent arrivals were found 
to toow little or no written or oral English and were included in 
the program with intensive and special remedial English as Second 
Language (ESL) instruction. Another 157 students were identified . 
as two or more grades behind in reading in English and they were 
included in the program. The basic bilingual curricultm consisted 
of instruction in basic school subjects in Spanish and English as a 
Second Language instruction. 

The target population had a dropout rate in excess of 
fifty percent.. Nearly all of these non-English speaking students 
are of low socio-economic status. Many of these students and their 
families are ineligible for and/or unaware of the various social and 
medical services that they may receive. As a result, the group is 
characteriEed by high absenteeism. 

The program was designed to provide a model for replication 
by other high schools with similar problems* It was intended to be 
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distinctive in two ways; 

!• It was to maKimize use of existing tax levy and ESL teaching 
personnal. 

2* Title VII funding was to be used solely to provide supportive 
services for the program and for unique instructional resourcas% 
the teaching components for Social Studies, Math and Science 
were to be made from tax levy funds. 

The Bilingual Program constituted a parallel pattern within 
the school. Pupils were given academic, non-academic and skill sub- 
jects in Spanish, Students took Social Studies, Science and Jtothematics 
in Spanish within the regular academic departments of Stevenson High 
School, Students were given intensive instruction in English- To 
achieve integration* the bilingual students simultaneously took other 
required courses such as Art* Music and Physical Education with the 
English speaking pupils in the regular program. The program offered 
bilingual pupils CKtra curricular activities such as films, museum 
visits* plays* speakers which were all used as a means to reinforce 
the cultural heritage while simultaneously introducing new culture. 

The Bilingual Program provided classroom personnel as follows i 
three content area specialists* social studies* science and math. In 
support of these personnel were one bilingual counselor and four edu- 
cational assistants all working under the supervision of a project 
director, with the assistance of a bilingual secretary. Additional 
personnel* from funds other than Title VII consisted of two ESL Teachers 
and two educational assistants (Title I)* while three teachers, math* 

6 
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sience and social studies were funded by tax levy. For Spring 1976 
one Native Language Arts teacher and one Educational Assistant were 
added. 

The program and evaluation were conducted within the social 

4 

context of the fiscal and budgetary crisis of New York City and New 
York State during 1975-76. This unprecidented crisis had direct and 
indirect impact upon school programs. There were direct results of 
the fiscal crisis upon the Bilingual Program at Adlal E. Stevenson 
High School. 

In 1975-76 the opening of the school year was plagued with 
a series of new reversals. A series of cutbacks In teaching staff 
and materials had Impact upon the program. Contract negotiation led 
to a teacher strike which delayed the opening of schools for five 
days. As a result of these considerations and other events throughout 
the school year, there were repercussions of the fiscal and budgetary 
crisis. There were a nimber of changes of staff during the school 
year 1975-76. The tax levy element of the program was hard hit by 
the fiscal budget crunch. Some of the program consequences from the 
austerity program led to fewer fully-licensed bilingual teachers and 
a delay In teaching and evaluation and reorganisation of the bilingual 
program with rCTalning resources. In this context * the Bilingual 
Program was carried out. 

The program objectives for Adlai Stevenson High Schof^l 
Bilingual Program were listed as follows f 
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Program Obj active No. I s To Increase the basic English 
Lahguage skills of students in the expressiva areas at least one 
level or Increment. 

Prograni Oblectlve Noy 2 | To Increase the vocabulary and 
reading comprehension in English of students by sIk school months 
or • 6 of a school year* 

Program Objective No. 3 i To Improve the reading ability of 
Hispanic students in the Spanish language to a statistically significant 
degree. 

Program Obiectlve No. 4A : To increase the general science 
achievement of students. 

Program Objective 4B : To increase the Biolo^ achieve- 
ment of students , 

Pro gram Objective #5A i To increase the achievement 
Ganeral Mathematics^ of students. 

Progr^ Objective #5B : To increase tha Algabra achieve- 
ment of students. 

Prog ram Objective #6 : To increase the toiowledge by ninth 
grade students of their cultural heritage md ethnic background. 

Progrm Objective #7 - To increase the attendmce of 

students , 

Program Objective #8 . To detennine how the program operations 
compared to program description and my discrepancy between the proposal 
and actual operations. 
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Oiapter 11* EVALUATION OBJECTIVES Mi'D PROCEIXJRES . 

Evaluation Objectives 

The evaluation objectives are parallel to the respective 
prograoi objectives for the Bilingual Program of Adlai Stevenson High 
School, TTiey may be listed precisely as follows i 

Objective 1 . To determine if there was a statistical signlfiQant 
improvement of Spanish spewing students in their ability to speak English, 
It was expected that 7S percent of the students will gain for tbe yett 
at least one saale rating in both the expressive and reQeptive modes when 
post test results of the New York City Language Fluency Scale are siibmitted 
to analysis. The treatment group consists of all Title VII pupils receiving 
instruction in English as a Second Language (ESL) in the Bilingual Program. 

Obj.^ctive 2 . To determine if the Spanish speaking students 
demonstrated a statistical sipiificant inprovement in reading achieve- 
ment in English. It was expected that the mem posttest reading score 
adiiaved by the treatment group will siurpass their pretest score at 
the .05 level of statistical signlficmce when results of the Stanford 
Achievement Test in Reading are siAmitted to analysis with a t test for 
correlated groups. The treatment group consists of all Title VII pupils 
in the Bilingual Progr an receiving English as Second Language (ESL) Instruction 

Objective 3, To determine if there was statistically significant 
improvement in Spanish speaking students reading in Spanish. It was 
expected that the mean posttest reading score achieved by the treat- 
ment group will suipass their pretest score at the *0S level o£ 
statistical significance when results of the Cooperative Inter-American 
Series Reading Comprehension Test are submitted to analysis with a t_ 
test for correlated groups. The treatment consists of all Title VII 
piqpils receiving subject matter instructibn in their native language 
(Spanish) in the Bilingual Progr&n. ^ 
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Qbjecti/e 4 . To deteimna if the students in the Bilingual 
ProgrMi attain achievement in science school subjects at or above the 
scores of a co^arable groi^ o£ students in the regular program of the 
school , 

Objective 4A , It was ejected that the ■ ^rcentage of 
treatment gro^ of Bilingual Program students who r>assed the teadier- 
made or other imiform final examination In general science would at 
least equal that percentage of selacted non-treatment students in general 
science. The treatMnt groi^ consisted of all Title VII pupils in the 
Bilingual Program receiving subject matter instruction In their native 
language. The comparison group consisted of a rmdomly selected group 
of piqjils who received the luentical curriculum in the English lanpiage 
in the regular sdiool program. 

Objective 4B . In regard to Biology classes from the two 
programs a Null hypothesis of no difference was posed. The Null hypothesis 
was to determine whether as a result of participation in the Bilingual 
program there was no difference between the percentage of students 
In the Bilingual program passing a Clty-Wlde Biology examination 
translated in Spanish and the percentage of con^arable Engllsh-dominant 
students passing a City-wide Biology examination within the school. 
All participants conqplate the Biology sequence in Januaxy and June^ 1976. 

Objective 5 . To detemine If the participants in the Bilingual 
Program attain achievement in Mathematics at the same level or above 
a comparable group of students from the regular programs of the school. 
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Objective 5A . It was expected that tha percentage of treatment 
group students in the Bilingual Program who passed the teacher-made or 
other uniform final examination in General Mathematics did at least equal 
that percentage of selected non-treatment students in General Mathematics 
The Bilingual group consisted of all Title VII p^ils receiving General 
Mathematics subject matter instruction in their native language. The 
Conparison gro^ consisted of a randomly selected gro^p of pupils who 
received the indentlcal curriculum In the English language. 

Objective SB . In regard to students who took Algebra m effort 
was made to determine whether as a result of participation in the program 
there were no differences between the percentage of students In the 
program passing a City-Wide Algebra examination in SpMlsh and the 
percentage of comparable English domlnmt students who passed a City-Wide 
Algebra examination from the school. The treatment group consists of all 
students In the Bilingual Program coD^leted the one semester Algebra 
sequence in January and June, 1976, The comparison group consisted of a 
randomly matched sai^le of Algebra students from the regular school 
program. 

Objective 6 . To determine if the participants in the Bilingual 
Program showed significMt gain in knowledge of Ethnic culture upon 
con^letion of a course especially deslpied for the course. 

It was expected that at least sixty percent of the treatTOnt 
group would attain at least the criterion level set for passed subject 
content when posttest results of teacher-made final examinations in Ethnic 
Culture were submitted to analysis. The treatment groi^ consisted of all 
Title VII pupils in ninth grade receiving instruction in Latin America 
area studies . 

11 
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Objective 7 . To determine if the attendance rate for the 
participants in the Bilingual Program was higher than the students in 
the regular program * 

It was ej^ected that the rate of attendance achieved 
by the treatment groi^ would su^ass the Con^arison group at 
the .05 level of statistical signiflcm.ce when pupil attendance 
results were iubmitted to analysis with a t test for percentage 
difference for uncorrelated groi:^s. The treatment group consisted 
of all Title VII participants in the program, TTie Coniparlson group 
consisted of all pupils in the school. 

Objective 8 . To determine how program operations con^)ared 
with the program description, ^ The evaluator assessed the Bilingual 
Program so as to determine gaps between the program as described and 
as actually carried out and studied the various processes used in 
program operation. 
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Table 1 



Objectives, Testing Instruments, Testing Dates, Groups Tested and Number of 
for Stevenson High Sdiool Bilingual Program 



Obj". 
# 


Objective 
Improvement of: 


Testing 
Instrument 


Pre- 
Test 


Post 
Test 


Groups Tested 


Nimiber 
Tested 


1 


Oral English 


New York City 

Puerto Rican Language 

Fluency Scales A 5 B 


Oct 


May 


All Title VII ' 
Students SSL 


lOS 


2 


Reading in 
English 


Stanford Achieve- 
ment Test Fjprm B 
Primary II 4 HI , 


Oct 


May 


All Title VII 
Students in 


93 


3 


Reading in 
Spanish 


Cooperative Inter- 
American Tests 
LCES» and: DES 


Oct 


May 


All Title VII 
Students 


185 


"4 


Science 


A) General Science 

B) Biology 


Jm 
Jan 


Jiiie 
June 


Title VII in 

Classes vs. 
Matched Sample 





From Repilar 

— ^ Procyram 

School Subjects Uniform final exams: Title VII in 

5 Mathematics A) General Math 5 Jan Jime Classes vs. 



B) Algebra Jan Jime Matched Sample 

From Regular 
Prnffram 



6 


Knowledge of 
Ethnic Culture 


Project-Developed Dec 
Examination 


May 


Title VII 52 
Students 

Ninth Grade Only 


7 


Attendance 


Bilingual vs. Regular 
Program Students 
Attendance Records 


June 


All Title VII 19S 
Students vs* 
Rest of School 
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Methods of toalysis 

The design stipulated the use of a series of statistical 
procedures for the analysis/ Thesm included (1) the correlated £ test 
between pre and posttests with a level of sipiificmce of .05 j (2) the 
t_ test of differences between percentage or proportions co^aring the 
Bilingual Program reiults with schoolwide noras; (3) the Wilcoxon Sign 
test of signiflc^ce of differences between pre mid posttest ratings 
on the language rating scale; (4) compare the percentage distribution 
of the attendmce rates in tems of percent of attendance rate for the 
Bilingual Progarm md the school as a whole, 

A systematic sajuple was drawn using a table of random nmbers 
from the alphabetical class lists from the regular program which is 
equivalent to a simple random sample* to match the regular class students 
to the bilingual program students, M overall summa^ of the evaluation 
objectives types of instruments used in the assessment, and types of 
statistical analysis used are listed in Table 2 to follow. 

In addition to the formal methods of research, informal. 

observation, interviews with staff and students were held* Pai analysis 
of records and documents was carried out . 



*Hubert Blalock, Jr. Social Statistics , New York McGraw Hill 1972 
page 514 . 
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Table 2 
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Objectives, Testing Instruments and Statistical Analysis Used in 



Stevenson 


High School Bil: 


Lngual Program 




nv* A 
# 


Objective 
Iniprovemont of 


i eating 

Instruments Used 


btatistical 
toalysis Used 


1 


Oral English 


New York City 
Language Fluency 
Scales A 5 B 


Wilcoxon Sign 
Rimks Test 


2 


Reading in 
English 


Stanford Adiieve- 
ment Test Forti B 
Primary II oriil 


Correlated 
T Test 


3 


Reading in 
Spanish 


Cooperative Inter- 
Ainericaii Tests 


Correlated 
T Test 


4 


Scion CO 


A) General Science 

B) 6 Biology 


T Test for 



School Subjects Department and Citywide 
Mathematics Teacher-made final exams 

A) General Math 5 

B) Algebra 



Systematic Sample 
Regular Classes 
with Bilingual 
Classes — 



Knowledge of 
Ethnic Culture 



Project Developed 
Examination 



Frequency Distribution 
Percent Passing Final 
Exam in Line with 
Criteri on 



Attendance 



Bilingual vs , Regular 
Program Students 
Attendance Records 



T-Test for 
Diffo rcnces 
in Percent 
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Chapter III. FINDINGS 

The findings of the evaluation of the Bilingual Program 
for Adlai Stevenson High School for ichool year 1975-76 will be 
reported in this section for each respective evaluation objective 
as listed In the evaluation design. 

Obi active l i. It was expected that at. least seventy-five per-- 
cent of the entire treatment group would improve at least one scale 
rating in both the eKpressiva and receptive modes when post-^test 
results of the New York City Language Fluency Scale were submitted 
to analysis. The treatment group consisted of all Title VII pupils 
receiving instruction in English as a Second Language (ESL) * The 
ability to speak English was measured by the New York City Language 
Fluency Scales A and B. In the Bilingual Program^ 105 ESL students 
were ;jlven a pre-test or post-^test rating* The results were analysed 
by the WilcoKon Sign Test for categorical data. Of the 105 students * 
there were 28 students who were rated at the lowest level ("F") on 
the pre-^testj by the end of the semester ^ ten pupils or 35.7 percent 
had improved two or more levels » There were 75 students who gained 
one or more levels on Scale A or 73 peroeiits while 73 students or Ik percent 
on Scale B. 

Table 3 

Wilcoxon Sign Test of Significance for Students at Stevenson High 
School for Ability to Speak English on New York City Language ' 
Fluency Scales A S B ^ & b 



Students' Results on Pre-Post Rat ings — 

Gain of One Loss "of One Remained on Wilcojcon 
^ ^ Jnore or more the same R 

^ Levels Levels Level 



B ^ II ' 22 6,536 

^ 77 8 20 6,634 
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0£ the 105 ratings of students who coraplatted the Scale B 
language ratings, the sum or positive rank was 3346 and negative ranks 
309. The Wilcoxon R for the Sign Test was 6.634 which was significant 
at the .05 level. 

Objective 1 % It was expectBd that the mean post-test 
reading score achieved by the treatment group at Stevenson High School 
would surpass their pre-test score at the .05 level of statistical 
significance when results of the Stanford Achievement Test in Reading 
were submitted to analysis with a T test for correlated groups. The 
treatment group consisted of all Title VII j upils receiving instruction 
in English as a Second Language (ESL) . 

There were 93 completed valid sets of Stanford Achievement 
tests usied to assess the students' achievement in reading English. 
The mean pre-test score was 2.325 grade equivalent scores and the 
mean post-test score was 3.011 or a difference of .69. This difference 
was above the criterion of .60 established in the proposal. Regarding 
the T-test, the sura of differences was 63.8 and the sum .of the squara 
of the differences was 56.58. The T-test score was 17.98 which was 
significant at the .05 level for 92 df. Of the 93 students from the ' 
Bilingual Program, 60 or 64.5 percent gained over half a year in grade 
equivalent. I'lie objective was^ attained. 

Table 1* 

T Test of Significance for Stevenson High School Bilingual 
■ProgrsD — Stanford Achievement Test in Reading 

N Pretest Mean Posttest Mean X„ S t * 

D D — 

-•3 2.32S 3.0118 63.8 S6.48 17.798 

17 
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Objective -' 3. It was ejected that the mean posttest 
reading score adiievad by the treatment group would surpass their 
pretest, score at the ,05 level of statistical significance when results 
of the Cooperative Inter-American Series Reading Conrprehension Test 
in Spmlsh were submitted to malysis with a t_ test for correlated 
groups. The treatment group consisted of all Title VII pupils 
receiving subJeGt matter instruction in their native Imguage CSpanish) 

Of the 240 students in the Bilingual Program there were 185 
valid C03T5}leted sets of tests in the Cooperative TnterAmerlcan Series 
Reading C 01155 rehens ion Test In Spanish Pruebas de Lectura? This was 
77 percent of the pupils. TTie mean score for the pretest was 37,64 ^d 
the posttest mean score was 52.01 with a difference of 14.4 the sume of 
the dlffarences was 2657, TTie svm of squares, of differences was 58487. 
Hie standard deviation was 17*78. The T test was 18,586 which was 
Jignif leant at .05 level for 184 df. 

Table 5 

T Test of Slpiificance for Reading in Spanish for Spanish Dominant 
Students at Stevenson High Sdiool Bilingual Program 

N Pretest Mean Posttest Mean Xp t 

185 37.643 52,010 2657 S8487 18.586 



^j.ntermedlata Level of Foras DES and CES were used. 
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Objective 4 . To determine If the students in the Bilingual 
Progifain attain achievement In school subjects in science at least 
equal to or above the attainment of a comparable group of students in 
the regular program of the school. 



group of Bilingual Program students who passed the teacher-'made or 
other unlfom final eMmination in General Science would at least 
equal that percentage of selected non--treatment studenti in general 
science. The treatment group consisted of all Title VII pupils in the 
Bilingual Program receiving subject matter instruction in. their native 
language* The comparison group consisted of a randomly selected group 
of pupils who received the identical curriculum in the English 
language in the regular school program. 



students in the General Sciences courses for Bilingual students was com-- 
pared with a matched sample of students from regular General Science 



revealed a T-*test of 2.4116 which was significant for at .05 level 
for 188 df , Of the 95 pupils in Bilingual General Science, 41 or 43 
percent passed the final examinations while there were 34 or 36 percent 
of the sample of students from the regular General Science classes 
who passed. 



Obi active 4A . It was eKpected that the percentage of treatment 



The analysis of results from the final eKamlnatlons for the 



classes. The T^test for Independent groups was calculated and 



Table 6 




N 



Post" test toan 



df; 



t 



Bilingual 
Regular 



95 
95 



60.863 
54, SI 



188 



2.4116^ 
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The analysis o£ results from the final eKaminatlons given 
to 64 students from the Bilingual Program in various courses in 
General Science was made with a matched randomly selected group of 
results from comparable courses in type and level from the regular 
progrMi* The T-^test for independent groups was calculated at 1.42 
with 126 df * which was not statistiQally significant* 



Table 7 

Test of Significanca for Independent Groups for Bilingual Classes versus 
Regulw Classes in General Science at Stevenson High School June 







Final Examination 






Classei 


N 


Mean 


d£. 




Bilingual 


64 


47.87 


126 


1.423 


Regular 


64 


S2.69 







There were 20 students of the 64 in the Bilingual Program or 
31 percent of the students who got a score of 65 or better on the 
final examination* Since one criterion established for this objective 
was that 60 percent of the students in the Bilingual Program would pass 
the final examlnatiorf. Only 31 percent passed $ bo in tems of this criterion th 
objective was not attained. The mean score for the group of students 
from the regular program was higher than the bilingual' group; however^ 
=the differences were not statistically significant* Of the 64 students 
from the sample of the regular program classes * 33 or 51 percent passed 
the final f Ifhile the students in the Bilingual Program did not pass 
the final eKaminatlon or attain the sixty percent criterion level, the 
meai performance score of stuaents in ztim bilingual Program was not 
significantly d,ii'feren"D trum S^Ue s'^Um^^uGb iu r^^u^ayr progjrftui* 
The two groups were Basically e^u^l iu their performance ^for this objeative. 



*The 60 percent criterion was stated as a 'pTogram objective. 
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Qbieetlve 4B , In regard to Biology classes from the two 
programs a Null hypothesis of no difference was posed. The Null 
hypothesis was to daterTOine whether as a result of participation in 
the Bilingual program there was no difference between the percentage 
of students in the Bilingual Program passing a City-Wide Biology 
examination translated in Spanish and the percentage of comparable 
English-dominant students passing a City-wide Biology examination 
within the sehool. All participants complete the Biology sequence 
in January and June* 1976* 

The analysis of the final examination scores for the bilingual 
program were matched by systematic sample from table of random numbers 
with students in the regular classes in biology. The T-test for 
independent groups was calculated and revealed a T*-score was equal 
to 1*542 which was not significant at .05 level with 208 df , Of the 
105 students, 49 or 47 percent passed in January from the Bilingual 
Program whereas from the 105 sample from the regular Biology^cras^^ 
53 or 50 percent passed. Neither group reached one of the esta"bllshed 

Tabla 8 

Test of Signiflcanoa for Independent Groups for a Matched Sample of 
Spmish Domin^t Students and Regular Classes in Biology at Stevenson 
High Sehool - Jmuaiy^ 1976 



Biology 
Classes 


N 


Biolpgy 
Post Test /Me an 


df. 


t_ 


Bilingual 
Regular 


lOS 
105 


55,97 
59,188 


208 


1.54 


The 


analysis of 


final examination scores 


given 


in June 1976 



for the students in Biology courses for Bilingual Program students 
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were compared with a group of students from the regular Biology classes 
using a systematie sample to randomly match students* The T--test for 
independent groups was calculated at 1*70 which was not significant 
for the .05 level with 122 df. For the results see Table #9 below. 
Of the 62 students from the Bilingual program, 39 or 62 percent got 
passing scores on the final examinations. This was above one criterion 
(bOpercent passing), In the regular program^ 32 students or 52 percent 
passed the Biology final lamination. 

Table 9 



Test of Significance for Independent Groups for Bilingual Classes versus 
Regular Classes in Biology at Stevenson High Sdiool - Jime^ 1976 







Final Examination 






Claisei 


N 


Mean For 


df. 




Bilingual 


62 


68. 8S 


122 


1.70 


Regular 


62 


64.52 







For Objective 4, compwlBons 'between the results of final examinations 
for Fall semester 1975 and Spring 1976 indicated that the objective 
was achieved in a comparative sense. In General Science, results showed that 
students from the Bilingual Program did significantly better than the 
sample of students In the regular program* In the Biology courses the 
students in the Bilingual Program did not do significantly better than 
the sample from the regular program. The: Bilingual Program students 
got higher scores in June, but not in January, Ibweverj in neither case 
were the differences significant.. Therefore, the Bilingual Program 
students did equally well with the students from the regular program. 
The standard for the objective, however, was not achieved. 
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Objective 5. To detennine if the participants in the Bilingual 
Program attain achievement in Mathematics at the same level or above 
a comparable groi^ of students from the regular programs of the school. 

Objective 5A. It was expected that the percentage of treatment 
group students in the Bilingual Program who passed the teacher-made or 
other uniform final examination in General Mathematics did at least equal 
that percentage of selected non-treatment students in General Mathematics. 
TTie Si lingual group consisted of all Title VII pupils receiving General 
Mathematics subject matter instruction in their native language. ITie 
Comparison groi^ consisted of a randomly selected group of pupils who 
received the Indentical curriculum In the English language. A systematic 
sample was drawn using a t^le of random numbers from the alphabetical . , 
class lists from the regular program which is equivalent to a simple 
random sample to match the regular class students to the Bilingual 
Program Students ,* 

results of the analysis of the T-Test for independent groups , 
slkoved, a mam for the Bilingual Group of 54. 3 and the mean for the students 
from the regular General Mathematics classes of 54. 9. TTie difference ).ietween 
means was .583. The T-test was .212 for 214 df. was not significant at the 



•See Hubert M. Blalock Social Statistics , New York, McGraw Hill 
page 514, ~ ~ ' 
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.05 level. An analysis of the results showed that 37 students in the 
Bilingual group or 34 percent attained passing final examination aaares 
while 40 students or 37 percent of the students passed th« final in 
the regular classes. In June, results were equal, 20 students « 31 
percent from the Bilingual and regular passed the final. The results 
showed that the students in the Bilingual Program General Mathematics 
classes and regular program classes attainment were not significant. 
Since the objective was to find out if the groups were equal or 
differed Significantly, the objective was obtained, since they did not 
differ at a level of statistical significance. 



Table 



Test of Significance for Independent Groups for Bilingual Classes versus 
Regular Classes in General Mathematics at Stevenson High School* - Januar, 
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Ktean 
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Bilingual 
Regular 


loa 

108 


54.324 
54.907 


214 


0.583 



Table IX 

Test of SignifioOTce for Indapendent Groups for Bilingual Classes versus 
Ragular Classes in General MathematiQs at Stevenson High School^^- June^ 



Clasjes 
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htean 
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Bilingual 
Regular 


6k 

6k 


kl.B73 
53.68? 


126 


lM3 



General Mathematics included 69 f„„ Mc 1 and 39 from MC 2, 
General Mathematics included 32 from MC 1 and 32^ f^^m MC 2. 
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Objective 5B , In regard to students who took Algebra ^ an ' 
effort was made to determine whether as a regult of participation in 
the program there were no differences between the percentage of 
etudeats In the program passing a City-wide Algebra examination in 
Spanish and the percentage of comparable English dominant students 
who passed a City-Wide Algebra eKamination from the school. The 
treatment group consists of all students in the Bilingual Program who 
completed the one seyyer Algebra sequence in January and June, 1976, 
The comparison group^^slsted of a random matched sample of Algebra 
students from the regular school program. Using the systematic sample 
as equivalent to a simple random sample p a matching group was draira 
from the regular Algebra classes equal to the number within the 
Bilingual Algebra classes* 

January 1976 Final Examination Results * It was contended 
that there would be no differences between the percentage of students 
passing the City-Wide Algebra examination in Spanish as compared with 
the percentage passing from the regular program* The rflsults showed 
that two students in the Bilingual group or 7.6 percent attained a 
passing City-Wide examination score and the ssfl^ple of regular classes 
in Algebra had one student or 3.8 percent of students who passed the 
City-^Wlde Examination* The results of the analysis for independent 
groups revealed a mean score for the Bilingual group In Algebra 
examination of 47.19 while the mean for the Algebra examination for 
the students from the regular classes was 37*115, The difference 
between means was 10,07. The T-test for independent groups was found 
to be 1,907 for 30 df, which was not significant at the ,05 level for 
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for a two-tall test. While the percent of students passing the 
Algebra Clty-Wlde examination was slightly different, the analysis 
of the T-test showed that the Bilingual, Algebra did slgnlf ieantly 
better than the matched sample from regular Algebra classes for January, 
Both groups were far below one criterion level of 60 percent pasalng* 

Table 12 



Test of Significance for Independent Groups for Bilin^al Classas versus 
Regular Classes in Algebra at Stevenson High SGhool - Fall 197S 



Clasias 
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Bilingual 
Regular 


26 
26 


47.19 
37.11 


SO 


1*907 


In 


June 5 1976, tl 


le students took the final 


examination 


on a 


school wide 


basis in Algebra | a matehed systematia 


s.ample w&i 


drawn 



from the regular claiseSp The results of the T-test.for independent 
groups revealed a mean on the final of 39*6 for the Bilingual group, 
and a mean for the sample of students from the regular classes was 
53.5. The difference between means was 13.9* The T-test for independent 
groups was found to be 4.38 for 122 df which was significant at the .05 
level for the two-tail test. See the results displayed in Table 13 
below. 

The comparison of the two groups in terms of numbers passing 
the Algebra with scores of 65 or better indicated that both groups 
were still far belpw the criterion or standard. From the Bilingual 
Program J 11 percent of the students passed the Algebra finals while 
there were 18 or 29 percent who passed Algebra from the sample of the 
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regular prosram. The Bilingual Program students did better in January 
than In June, but the objective was not attained for Algebra for the 
school year. Although the results for the tvo groups were basically 
similar in January, the results for the regular- elasses were signifi- 
cantly higher in June. 



Table 13 



Test of Significance for Independent Groups for BlllnBusl n 

versus Regular Classes in Alg.bra at StevLsf^^igh'Sol'^lprLg 1976 

Classes ~ ^ — ~- 

Group N Final Examination — — — — — 

*^ " Mean For 



Bilingual 62 39.6^5 

Regular 62 53.548 



4.38" 
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Objective 6 , To deteimna if the participants in th© Bilingual 
Program showed significant gain in knowledge of Eldinic culture upon 
completion of a course especially designed for the course. 

It was expected that at least sixty percent of the treatment 
group wwld attain at least the criterion level set for passed si^ject 
content when posttest results of teacher-made final examinations in Ethnic 
Culture were submitted to analysis* The treatment p^oup consisted of all 
Title VII pupils in ninth grade receiving instruction In Latin Merican 
area studies* 

On the basis of the malysis of the results of the final 
examination for the 52 ninth graders who took the course in Latin american 
area studies there were 39 students or 75 percent who attained a passing 
score. It is clear that the objective was attained in the study of Ethnic 
Culture, The distribution of results are depicted in the Table . 

Table ik 

Distribution of Final Examination in Ethnic Culture Test for Ninth Graders 
in Bilingual Progr"=m 



Final Examination 


Bilingual 


Results 


Students 


100-95 


0 


95-85 


1 


8S-7S 


10 


75-65 


2S ■ , 


6S-5S 


8 


SS-4S 


6 


45 -Be low 


4 
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Objective 7 . To determine if the attendance rate for the 
parti cipmts in the Bilingual Program was hi^ar thm the students in 
the regular program. 

It was expected that the rate of attendance achieved 
by the treatment group would surpass the Comparison group at 
the .05 level of statiBtical significance when pupil attendance 
results were siAmitted to malysis with a t test for percentage 
difference for uncorrelated groups. ITie treatment group consisted 
of all Title VII participants in the program. The Comparison group 
consisted of all pupils in the school. 

To detemine if students in the Bilingual Progr™ will have 
a higher daily attendmce rate thm the rate established for the entire 
student body at Stevenson High School* Hie special nature o£ the Bilingual 
Program was expected to provide added incentives to students for attending 
school* It was expected that the program holding power would be reflected 
in terns of batter daily attendance In the Bilingual Progran than the 
regular program. 

The assessment of the attendance was based upon school records 
for attendance pertaining to students in the Bilingual Program as well 
as those within the regular program. TTie procedures used included the 
attendance for the students in the Bilingual Program during the first 
five grading periods and the attendance for the student body as a whole 
during the first five grading periods (September 1976-May 1976). 

A review of attendance records revealed that the attendmce 
criteria was exceeded by -die students in the Bilingual Program. The 
results are depicted in Table clearly show the objective was 

achieved. A detailed analysis of results showed the outstanding attendance 
record for the various subgroups in the Bilingual Program, — . 

29 
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Using the 16S days of sdiool attendance for the nine-month 
period as a basis ^ a iimmary of number of days present md days absent 
for eaeh student in the Bilingual Prograjn was collected and the data 
were analyied. 

Ab' reported from Eeeolfds the mean percent of , those present for 
^e sohool year 1975-76 for Stevenson High School students in the regular 
program was 71.5 percent. The mean percent present for the school year 
1975-76 for the Bilijigual prograin students was 86*7 percent which was 
higher thm the school mean. The difference in mean percent attendmce 

between the biltogual md regular progrm students was found to be 
15,2. A test for the significance of the differences between percent of 
uncorrelated groups was made, ^he z score was 4.611 which was significant 
beyond the .05 level with a two tail test* This indicates that the 
objective was adiieved^ since the attendmce of the Bilingual Program was 
significmtly higher thm the regular program* 

Table 15 



Stevenson High School Attendance of Students from Bilingual Program and 
Students from Regular Program 
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Bilingual Program 




Regular Program 




Percent Present 


N 


Percent Present 


Difference Score 


195 


86. 


3800 


71 .S 


15.2 4.611 
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Table l6 

Stevenson High School Bilingual Program Distribution of Students and 
School Attendance 



Percent Present Days Number of 

for School Year Students 



Between 95 


and 


lOOi 


46 


90 


and 


95 s 


48 


85 


and 


90! 


36 


80 


and 


853 


21 


75 


and 


80: 


12 


70 


and 


75: 


7 


65 


and 


70: 


4 


60 


and 


65 1 


5 


55 


and 


60: 


2 


50 


and 


55: 


3 


Below 49s 


3 
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Objective 8 . To determine how program operations compared 
with tiie program deicription, evaluator assasied the Bilingi^^l 

Program so as to determine gaps between the program as deSQilbed and 
as actually carried out and studied the various processes used in 
program operation, 

T^e evaluator observed program activity, conducted interviews, 
and examined pertijient records to determine the extent of congruence 
between program proposal specifications md tht actual implementation 
of the program, 'nie evaluator observed activity and interviewed key 
personnel in order to deteimine the strangths and the weaknesses of the 
Bilingual Program so as to provide recommendations for recycling, planning 
and staff developinent , Two key areas of attention were staff development 
and cia'riculum development. Hiese data ai5 provided summarily in the final 
evaluation report* 

There were a number of major progrM components that operated 
in addition to the cognitive objective the focus of this evaluation. 
The major components of the Bilingual Programs to be discussed ares 
(1) Fiscal Crisis and Bilingual Program for 1975-7 6 | (2) Organization 
of the Bilingual Program; (3) Curriculum Development | (4) Staff Development; 
(5) Co-currlcula and Cultural Activities; (6) Parent and Community Involvement i 
and (7) Testing and Number of Tests completed* 

Fiscal Crisis and the Bilingual Program . The Impact of the 
fiscal crisis was felt within the Bilingual Program with staff shifts 
and heavy load upon Department Chairmen. The administrative work con- 
tinued, but with fewer faculty members and with larger classes^ placed 
a burden upon all. The delay In the opening of . school in September, 
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in effect, produced a shorter semester and the shifts in staff In 
Scienee classes had special impact. 

Organization- of the Bilingual Program , The Bilingual 
Program is in a unique poaition within the authority structure and 
organisational structure of Adlai Stevenson High School. The Director 
of the Bilingual Program has a small key staff of Bilingual teachers 
and reaouree members for a aeries of courses from the regular departments 
of the school. The accountability of staff is to both the regular 
departments and to the Bilingual Program, The Bilingual Program 
director is eKpected to coordinate through ttie SKisting Department 
Chairmen. The Bilingual Program is growing and the role of the Program 
Director is growing more compleK. 

Curriculum Pevelopment . During the 1975-76 School year, the 
staff developed bilingual curriculum in ninth grade mathematics * ESL, 
ninth grade Biologyp United States History^ Area StudleSp Latin Culture. 
The staff developed project tests and translated materials , some Into 
English and others into Spanish, The Counseling services for students 
included group sessions on a weekly basis for 20 students in Fall 
semester and 30 students in the Spring semester. These sessions for 
the non-English-speaking youth covered a range of considerations such 
as orienting them to New York City^ and helping youth with a range 
of emotional problms over the school year. 

Staff Development , Staff meetings were held on a regular 
monthly basis in the Bilingual Program. The topics discussed Included i 
Orientation to Title VII, and the evaluation and testing responsibilities | 
language mix in Bilingual classes i the role of paraprof essionals | 
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indiyidualized instructioni curriculum development issuesi scheduling 
and types of classes | organization of the Bilingual Program in Steven- 
son High School I use of affective teaching techniques; linguistic 
usage in social studies and science in Bilingual classes | philosophy 
of bilingual education i planning field trips and follow up| and other 
topics. There were relatively few school-wide faculty meetings, but 
the overall faculty mm informed about the Bilingual Program throughout 
the year. 

Co-Curricula Activities and Cultural Events , The Bilingual 
Program undertook a number of field trips and other cultural events 
during the school year. These events were linked with the main cur-* 
riculum and course objectives were tied to the €ield trips from 
various courses. The field trips includedi Museum of Hispanic Society^ 
Hayden Planitarium, ^erlcan Muaeum of Natural History, Museo del BarriOp 
Independence Park in Philadelphia, College Fair sponsored by ASPIRA -Hew York 
University, Other events included music and dance and drama. The 
events also included Ballet Hispanico in New York City and La Carre ta, 
as well as the movle^ Los Tarantos , One event was cancelled, but the 
Director called the artist, Sablcas, who agreed to comfi directly to 
the high school to perform. He gave his guitar concert for the student 
body. The Sablcas concert was a hit with the entire school. 

Parent Involvement . The parents advisory comittee met 
monthly and aided in open house meetings with other parents and planning ■ 
various cultural events of the school year. The coraalttee reviewed 
the Bilingual Program^ its testing program and curriculum and general 
Title VII provision as well as the plans for ^1976-77 | the parents 
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committee sought to get more collage advising and more job placement. 
The parents' role in the school proved to provide support and suggestions 
during the year and could be more important in the future. 

The Testing Program and Number of Teste Gompleted t The 
opinions about the testing program by the staff and Director included 
the following obsergrations* The New York City Language Fluency scale 
is too subjective relying only upon teacher rating* The New York City 
Language Aosessment Battery (LAB) is still under development. The main 
criticism of it is the amount of time it takes for administration* 
The Stanford Achievement Test in reading was standardized with noras 
for "white middle class English-speaking suburban youth." ^ The Coopera- 
tive Inter-toerlcan test in Spanish Language has greater emphasis on 
science and other areas than has been part of the eKperience of the 
students in the program. 

In 1975-76 i the Title VII Bilingual Program Included 157 

* 

students who were found to have scored below 21 percentile in English 
on the New York City LAB Language Assessment Battery^ and above their 
English percentile score in their Spanish test results. These students 
were assigned to the Bilingual Program in line with the Consent degree. 
The New York City LAB testing took considerable staff time. In addition, 
to the students from the Consent degree^ there were others enrolled, 
some volunteered for the program and still others that teachers recomended 
to the total of 230 students In the Bilingual Program. 

The number of students tested In the evaluation and the sample 
of tests were within the guidelines of 75 percent of the possible ' 
sample. The variations in numbers were due to the size of enrollment 
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f ^r the respective alasses. For Objective No, 1, there were 
105 students who ware in ESL with completed scores* For Objective 
No. 2 5 there were 93 completed tests for the ESL students. For 
Objective No, 3, 185 students in the progrm took the Spanish tests, 
these were the 93 non-^lngllsh speaking students as well as the English 
speaking students. For Objective No, 4, there were 95 Biology and 105 
General Science students. There were 1T2 General ^mathematics students* 
tests completed and 88 students who took tests for Algebra. There 
were 92 ninth graders who took the ethnic culture test for Objective 
No, 6. 
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IV. Sl^mRY OF MAJOR FINDINGS, CONCLUSIONS mP RECOmENDATIONS 

Findings Sununarized 

There were nine objectives to the evaluation of the Bilingual 
Program at Adlai E. Stevenson High School. TTie findinga for each 
objective will be listed in summary fashion with brief discussion of 
conclusions and recomnandations to follow. 

Objective 1 , / To determine if the Spanish speaking 
students in the Bilingual Program showed significant improvement in 
ability to speak and to imderstand English, Results showed that 
a significant number of students showed gain of one or more levels 
in the rating used. One may infer that the objective was adiieved. 

Objective 2 , To assess changes in reading in English 

for the Spanish speaking students enrolled In English as Second Languafee classes 
Results showed that the students In the Bilingual Program did 
show significant gains in their reading in English during the 
School year. It is possible to infer that the objective of gain in 
reading English was. achieved by the students this year* 

Objective 3 , To determine if the Spanish speaking 
students showed significant improvement in their reading in Spanish 
Results showed that the students did show significant improvement 
in reading in Spanish and the objective was achieved* 

Objective 4 . It was expected that students in the Bilingual """^ 
program would gain in their achievement in General Science and Biology classei, 
^he gain would be equal to the percentage of those who pass the final exam frorn a 
matched group of students for similar classes in the regular program 
of the school. The results showed that students in the General Science 
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classes in Januaiy did better in comparison with the regular classes, 
in June the Bilingual program students did not do better than the 
regular classes. This indicates that the objective was only in part 
achieved for General Science. 

In Biology, students from the Bilingual Program in Januaiy 
were found to have not done as well in conparison to the pupils from 
Biolo^ in the regular program on the Citywide examinations . In June 
the results however, showed that the students from the Bilingual Program 
did attain the objective in conparisons with the Biology students in 
the regular program on the Citywide examinations. Therefore, it is 
possible to state that the objectives for Siol^ay were in part achieved, 
and in part were not. 

Objective 5. It was expactftd thai; the percentage of passing 
students from the bilingual Prograi^ ^n various mathematics classes would 
be at least equal to -hu percent of students passing final examinations 
from the regular program mathematics classes. Analysis of results for 
General Math classes in January showed that percent of the 

students passed, while in June 37 percent of the sluaents passed final 
examinations. TTiese figures show there were propcMionally less than 
these passing from the regular progrem. Neither In January nor in June 
did the t test show a significant difference. Therefore, the results 
of the two eroups were basically similar and the objective vas attained. 
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In the Algetra alassee, it was found that k percent 
passed in Janua^ comparecL with 8 percent of the students from the 
Bilingual Progrin, In June^ 11 percent of the students passed Algebra 
from the Bilingual Program, while 29 percent of the students passed 
from the regular Algehra classes, in teiTas of the si:rty percent 
criterion. But neither group attained that criterion* Since the 
differences in results frcM the two groups were not significantly 
different in overall perfomance for the school yesi'j they were 
tasically stailar. In this respect the ohJectiYe was attained. 

Objective 6 . It was e^^ected that at Isait sixty percent 
of the pupils would show significant gain in knowledge of Ethnic 
Culture upon conpletion of a courte in Latin Area American Studies at 
Stevenson High School, Results for the ninth graders who took- the course 
showed that 7S percent passed the final examination, A comparison of 
pre and post test scores showed a significant gain for students. Hie 
objective \vas achieved. 

Objective 7 . It was expected that the attendance rate of the 
students in Stevenson High School Bilingual Program would be equal to 
or better than the overall school attendance. Results showed that the 
attendance rate for the students was batter for the students from the 
Bilin^al program than for the school as a whole* The objective was 
achieved* 

Objective 8 , It was expected that there would be some gap 
between descriptidn and the actual operation of the Program, The 
evaluator assessed the descrepancy between program description 
operations but found that the major elements of the program elements 
were carried out as described. 
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In suiimiary^ the Bilingual Program achieved its objeetives for 
iaprovement in speaking English (Objective #l)i in reading gains in 
Spanish (Objective #3); and gains in knowledge of Ethnie culture 
(Objective #6). The program did not achieve its objective for rigor- 
ous significant gains in reading in English (Objective #2)^ but the 
students did ©Kceed the 'criterion of ,6 grade equivalent gain. The 
evaluation design called for compajflsg student perfo^nce for both prograni for 
a number of the objectives. It was expected that they would be equal. 
In this regards matching was made by systematic sample of students 
from the regular program results on final examinations and Clty^ 
^^de tests which compared students from comparable courses in the 
Bilingual Program, ^ These results indicated that while fewer students 
from ^he Bilingual Program passed respective examinations at the 
criterion level than the students from the regular program, the dif-- 
ference in Mean scores and T test for uncorrelated groups were not 
significant. The results were basically equal. The Mlingual pro- 
gram students' scores in final examinations in Sciences (Objective 
7/4) and Mathematics (Objective #5) were less than those of students 
from the regular program^ but these differences were not significant. 
There were exceptions. Students from the Bilingual program had sig- - 
nif icantly higher attendance in terms of percent days present than 
the mean percent present for the school as a whole (Objective #7), 
This was remarkable given the generally high rate of abeenteelsm in , 
the past, 
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ConQlualene 

On the basis of the findings in the evaluatipn of Bilingual 
Program for Stevenson High Sehool it li possible to conclude that 
the atudents did achieve some of the objectives. 

The results of the testing may be viewed In terms of relative 
gain, there are some indications of Jjiprovement among the students 
in the Bilingual Program* When the levels of performance are viewed 
in comparative terms with the norms of the youth from the larger 
society, it Is clear that the students are far behind in grade level 
of performance for a number of subject areas. In terms of affective 
dimensions J the remarkable Improvement In attendance was a sign of 
progress for students who had a high Irate of prior absenteeism. The 
level of performance constitutes a continued challenge to the staff 
of the Bilingual program. 

The place of the Bilingual Program within Stevenson High School 
has been developed more this year. The role of the director in 
relationship tb the department chairman is compleK. The role requires 
coordination and liaison among faculty who work wit n two types of 
programs. In the tight fiscal situation of New York City Schools, 
this year department chairmen had fewer teachers and an Increase in 
administrative tasks* In effect p the Bilingual Program constituted 
another set of tasks. These point to the need for the coordination 
and liaison of the Bilingual Program to be increased. 

The Bilingual Program at Stevenson has developed its curricula 
activities through school programs and field trips and through devel- 
opment of group counseling in the guidance of students. These efforts 
and others have augmented the classroom instruct Ian and have con- 
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tributed to the imagm of the Bilingual Program within the school. 

There has been staff development and curriculum development within 

the Bilingual Program during the year which has strengthened the 

program by the end of the ichool year. The Bilingual Program has 

operated in relationship to the largef regular program of the school 

within the tense context surrounding the fiscal crisis of New 

York City schools* Teachers had large classes and less time to 

carry out special projects such as the Bilingual Program. 
Recanmendations 

The recommandations made for the Bilingual Program of Stevenson 
High School are based upon the findings of the evaluation during 
the school year 1975-76. These recoDmendatlons pertain to the 
evidence gathered directly for each of the evaluation objectives 
and the broader goals of the program assessed during the school 
year. These reconmiendatlons pertain to the current operation and 
have implications for next year's Bilingual Program. 

The efforts to concentrate upon language development be con-- 
tinued. It was clear that students in the Bilingual Program made 
progress in the Spanish language ^ but more attention is needed in 
reading in English, The ESL course work is intensive, but the 
development of more skills among staff and improved curricula 
should be encouraged* It is recomiended that the concentration on 
language be intensified^ and more inservlce staff development 
and curriculum development be carried out in 1976-77* 

The place of the Bilingual Program within the regular pro^ 
gram, of Stevenson High School could be clarified. The status of 
the Director in relation to the Department Chairman should be 
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clarified. The present structure calls for faculty to serve two 
programs and lines of authority and accountability could "be clarified. 
Clarification could minimize third party conraunications and would 
enable direct superv'laion and more effective Iniervice training to 
take place* At present some of the teachers may feel prior duties 
to their respective subject department and not the Bilingual Progrm. 

The relationship of the Bilingual Program to the larger school 
could continue to be developed. It is recomended that one additional 
technique for inservlce ataff development could be to achedule pre^ 
sentatlon of the Bilingual Program during regular faculty meetings 
when they are held during the school year^ Few faculty meetings 
were held this year. These meetings provide a chance for issues of 
Bilingual Program to be openly discusaed within the context of the 
larger faculty of the school. At the present time, the Bilingual 
ProgrOT Is viewed functionally^ more through the eyes of each depart^ 
ment of the school than as an entity providing a parallel system 
within the regular school. It la recommended that another alter- 
native to conalder would be for the Director to work in liaison 
with the Department Chairman regarding the Bilingual Program, pro- 
viding their respective inpute in the planning of staff development 
seas ions during 1976^77 • Given the large classes and fewer teachers 
the staff training with thg Eupport of department is crucial. 

The testing program within the school requires a great deal 
of staff time and student effort. It is recomended that concept 
of criterion based and normative based testing be developed for 
staff understanding. It is also recommended that in ataff training 
that more uses of the diagnostic results of tests be utilised in 
the instructional program. It is recoimended that guidance functions 
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include attention to job placement for youth as well as college 
preparation. It is recommended that some thought and plans be 
made for securing funds for a longitudinal study of the students 
in the Bilingual Program. The changes in attendance and other 
changes in affective areas may be a first step toward changes in 
cognitive areas. Such a study would need to be for a number of 
years. ■ 

The year 1975-1976 has been a year of crisis for schools and 
other agencies within New York City, perhaps a regular staff and 
stable personnel and clear direction for curriculum and staff 
development in 1976-77 will provide a year of less tumult and 
more progress in Bilingual Program. 

On the basis of the evidence in this evaluation, it is recom- 
mended that the Bilingual Program be funded with the specific 
recommendations and coments taken into account. 
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